SAM2.PAU32 (DMS03-D10) 




11 MAIL STOP AF 

REPLY UNDER 37 CFR § 1.116 
EXPEDITED PROCEDURE 
TECHNOLOGY CENTER 



UNITED STATES DEPARTMENT OF COMMERCE 
PATENT AND TRADEMARK OFFICE 
PATENT EXAMINATION BRANCH 



In re Application of: 



XianglinWANGetal. 



Examiner: Torres, Jose 



For: METHOD AND APPARATUS FOR 
IMAGE INTERPOLATION BASED 
ON ADAPTIVE POLYPHASE 
FILTERS 



Group Art Unit: 2624 



Confirmation No.: 7881 



Appln.No.: 10/697,358 



Response to Office Action 
dated October 17, 2007 



Filed: 



October 30, 2003 



RESPONSE TO FINAL OFFICE ACTION OF OCTOBER 17. 2007 
AND REOUEST TO WITHDRAW FINALITY OF THE OFFICE ACTION 

MSAF 

Commissioner of Patents 
P.O. Box 1450 

Alexandria, VA 22313-1450 



This is a Response to the final Office Action dated October 17, 2007. 
Reconsideration and allowance of the claims is respectfiiUy requested in view of the 
following amendments and remarks. Please charge any deficit or credit any stirplus to 
our Deposit Account No. 01-1960. A duplicate copy of this page is enclosed for this 



Dear Sir: 



purpose. 



Amendments to the Claims begin on page 2 of this paper. 
Remarks begin on page 20 of this paper. 



Patent Application No. 10/697,358 

Amdt. Dated December 7, 2007 

Response to Office Action of October 17, 2007 



Docket No. SAM2.PAU.32 



Amendments to the Claims: 

This listing of claims replaces all prior versions of the claims in the patent application: 

1. (Previously presented) A method of interpolating image positions in an original 
image to produce an interpolated output image, wherein the original image is represented 
by digital input pixel data, comprising the steps of: 

(a) providing a first filter having a sharp interpolation characteristic; 

(b) providing a second filter having a smooth interpolation characteristic; 

(c) interpolating a selected image position in the image using the first filter to 
generate a sharp interpolation output value; 

(d) interpolating the selected image position in the image using the second 
filter to generate a smooth interpolation output value; 

(e) calculating a different weighting coefficient for the output of each filter by 
estimating a high frequency level at the interpolated selected image position and 
calculating the weighting coefficients based on the estimated image high frequency level; 
and 

(f) selectively combining the output values from the filters as a function of 
the weighting coefficients, to generate an interpolation output value for the selected 
image position of an interpolated output image. 

2. (Canceled). 
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3. (Currently amended ) A method of interpolating image positions in an original 

im^e to produce an interpolated output image, wherein the original image is represented 

by digital input pixel data, comprising the steps of: 

(a) providing a first filter having a sharp interpolation characteristic: 
(h) providing a second filter having a smooth interpolation characteristic: 
(c) interpolating a selected image position in the image using the first filter to 

generate a sharp interpolation output value: 

fd) interpolating the selected image position in the image using the second 

filter to generate a smooth interpolation output value: 

(e) calculating a different weighting coefficient for the output of each filter by 

estimating a high fi'equency level at the interpolated selected image position and 

calculating the weighting coefficients based on the estimated image high fi-equencv level: 

and 

({) selectively combining the output values from the filters as a function of 
the weighting coefficients, to generate an interpolation output value for the selected 
image position of an interpolated output image 

The method of claim 1 , wherein the weighting coefficient a for the first filter output is 
calculated according to the relation: 

min(l, max(0, {(p-T^)l{T^ -r^) ) ) 
wherein cp is the image high frequency level estimated for the given 
interpolation position, Tj and T2 are two pre-determined threshold values where 
r2>r3>0;and 
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the weighting coefficient for the second filter output is (1 - a) . 

4. (Previously presented) The method of claim 1 , wherein the interpolation output 
value q for the selected image position is according to the relation: 

g = r*a-i-5*(l-i3f) 

wherein a and (1 - a) are the weighting coefficients for the first and 
second filters, respectively (0 < a < 1 ), and r and s are the filter output values from the 
first and second filters, respectively. 

5. (Original) The method of claim 1, wherein: 

the first filter comprises a polyphase filter; and 
the second filter comprises a polyphase filter. 

6. (Original) The method of claim 5, wherein: 

the first filter comprises a one dimensional FIR polyphase filter; and 
the second filter comprises a one dimensional FIR polyphase filter. 

7. (Original) The method of claim 5, wherein the two polyphase filters have the 
same length. 

8. (Original) The method of claim 5, wherein each of the polyphase filters 
comprises a N -tap M -phase polyphase filter. 
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9. (Original) The method of claim 8, wherein for arbitrary or variable 
interpolation ratios, M has a value of 10 or larger. 

10. (Original) The method of claim 8, wherein N can be either an odd or an even 
number value. 

1 1 . (Original) The method of claim 5, wherein the two filters m-e low-pass filters, 
such that the first filter has a sharp frequency transition band and the second filter has a 
smooth fi-equency transition band. 

12. (Original) The method of claim 8, wherein: 

calculating the weighting coefficient for each of the two filters further 
includes the steps of: estimating the image high frequency level at the selected image 
position, and calculating a weighting coefficient for the output of the filter based on the 
estimated image high frequency level; and 

the image high fi-equency level at the selected image position is estimated 
based on the image high frequency components measured at original image pixels 
neighboring the selected image position. 

13. (Original) The method of claim 12, wherein the image high frequency 
component at the original image pixels is measured using a high-pass filtering process. 
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14. (Original) The method of claim 13, wherein the image high frequency 
component at the original image pixels is measured using a high-pass FIR filter. 

1 5. (Previously presented) A method of interpolating image positions in an 
original image to produce an interpolated output image, wherein the original image is 
represented by digital input pixel data, comprising the steps of: 

providing a first filter having a sharp interpolation characteristic; 

providing a second filter having a smooth interpolation characteristic; 

each of the filters comprises a iV-tap M~phase polyphase filter; 

interpolating a selected image position in the image using the first filter to 
generate a sharp interpolation output value; 

interpolating a selected image position in the image using the second filter to 
generate a smooth interpolation output value; 

calculating a weighting coefficient for the output of each filter by estimating the 
image high firequency level at the selected image position based on image high fi-equency 
components measured at original image pixels neighboring the selected image position, 
and calculating the weighting coefficients based on the estimated image high j&equency 
level; 

selectively combining the output values fi-om the filters as a function of the 
weighting coefficients, to generate an interpolation output value for the selected image 
position of an interpolated output image ; 
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wherein the image high frequency component at each of the original image 
pixels is measured according to the relation 

wherein is original image pixel value where image high frequency 
component is to be measured, and p^_^ and p^^^ are original image pixel values of the 
neighboring pixels. 

16. (Original) The method of claim 15, wherein the image high frequency level 
q> at the selected image position is estimated according to the relation: 

2 

N N 
wherein z = — + 1,- - ,0, - • s — are the image high frequency 

components calculated at the original image pixels that are within the filtering range of 
interpolation to the selected image position, fj^ and g/ are filter coefficients of sub- 
filters and for the first filter and the second filter, respectively, and j is the 
interpolation phase for the selected image position. 

17. (Original) The method of claim 12, wherein the image high frequency level at 
the selected image position is estimated based on the image high frequency components 
calculated at two original image pixels closest to the selected image position. 
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18. (Previously presented) A method of interpolating image positions in an 
original image to produce an interpolated output image, wherein the original image is 
represented by digital input pixel data, comprising the steps of: 

providing a first filter having a sharp interpolation characteristic; 

providing a second filter having a smooth interpolation characteristic; 

each of the filters comprises a iV-tap M -phase polyphase filter; 

interpolating a selected image position in the image using the first filter to 
generate a sharp interpolation output value; 

interpolating a selected image position in the image using the second filter to 
generate a smooth interpolation output value; 

calculating a weighting coefficient for the output of each filter by estimating the 
image high frequency level at the selected image position based on image high frequency 
components measured at original image pixels neighboring the selected image position, 
and calculating the weighting coefficients based on the estimated image high frequency 
level; 

selectively combining the output values from the filters as a function of the 
weighting coefficients, to generate an interpolation ou^ut value for the selected image 
position of an interpolated output image; 

wherein the image high frequency level g) at the selected image position is 
estimated according to the relation: 
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wherein and (j>^ are the image high frequency components calculated at 
the two closest original image pixels, and are the distances between the selected 
interpolation position and the two closest original image pixel and the distance between 
two neighboring original image pixels is assumed to be 1 , such that dQ+d^=\. 

19. (Original) The method of claim 12, wherein the image high frequency level at 
the selected image position is estimated based on the image high frequency component 
measured at original image pixels that are within the filtering range of interpolation to the 

selected image position. 

20. (Previously presented) A method of interpolating image positions in an 
original image to produce an interpolated output image, wherein the original image is 
represented by digital input pixel data, comprising the steps of: 

providing a first filter having a sharp interpolation characteristic; 

providing a second filter having a smooth interpolation characteristic; 

each of the filters comprises a iV-tap M -phase polyphase filter; 

interpolating a selected image position in the image using the first filter to 
generate a sharp interpolation output value; 

interpolating a selected image position in the image using the second filter to 
generate a smooth interpolation output value; 

calculating a weighting coefficient for the output of each filter by estimating the 
image high frequency level at the selected image position based on image high frequency 
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components measured at original image pixels neighboring the selected image position, 
and calculating the weighting coefficients based on the estimated image high frequency 
level; 

selectively combining the output values from the filters as a function of the 

weighting coefficients, to generate an interpolation output value for the selected image 
position of an interpolated output image; and 

wherein the image high frequency level tp at the selected image position is 
estimated according to the relation: 

a 

9= l;(0.5*(/_i,+5_^,>,)*i^.) 

I- — +1 
2 

N N 
wherein <f>^, i = — — + 1,- • - A- • — are the image high frequency 

components calculated at the original image pixels that are within the filtering range of 
interpolation to the selected image position, // and g/ are the filter coefficients of sub- 
filters and for the first filter and the second filter, respectively, and j is the 
interpolation phase for the selected image position. 

21. (Previously presented) An interpolation system that interpolates image 
positions in an original image to produce an interpolated output image, wherein the 
original image is represented by digital input pixel data, comprising: 
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(a) a first filter having a sharp interpolation characteristic, the first filter 
interpolating a selected image position in the image to generate a sharp interpolation 
output value; 

(b) a second filter having a smooth interpolation characteristic, the second 
filter interpolating the selected image position in the image to generate a smooth 
interpolation output value; 

(c) a controller that calculates a weighting coefficient for the output of each 
filter by estimating a high frequency level at the interpolated selected image position, and 
calculating a weighting coefficient for the output of the filter based on the estimated 
image high frequency level; and 

(d) a combiner that selectively combines the output values firom the filters as a 
function of the weighting coefficients, to generate an interpolation output value for the 
selected image position of an interpolated output image. 

22. (Canceled). 

23. (Currently amended) An interpolation system that interpolates image positions 
in an original image to produce an interpolated output image, wherein the original imag e 
is represented by digital input pixel data, comprising: 

(a) a first filter having a sharp interpolation characteristic, the first filter 
interpolating a selected image position in the image to generate a sharp interpolation 
output value: 
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(b) a second filter having a smooth interpolation characteristic, the second 
filter interpolating the selected image position in the image to generate a smooth 
interpolation output value: 

(c) a controller that calculates a weighting coefficient for the output of each 
filter by estimating a high frequency level at the interpolated selected image position, and 
calculating a weighting coefficient for the output of the filter based on the estimated 
image high frequency level: and 

(d) a combiner that selectively combines the output values from the filters as a 
function of the weighting coefficients, to generate an interpolation output value for the 
selected image position of an interpolated output image 

The system of claim 21 , wherein the controller calculates the weighting coefficient a for 
the first filter output according to the relation: 

c^ = min(l, max(0,(^27-7;)/(r2-ri))) 

wherein tp is the image high firequency level estimated for the given 
interpolation position, Tj and are two pre-determined threshold values where 

> Tj > 0 , whereby that the weighting coefficient for the second filter output is (I -a), 

24. (Previously presented) The system of claim 21, wherein the combiner 
determines the interpolation output value q for the selected image position according to 
the relation: 

q = r*a: + 5'*(l-a) 
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wherein a and (1 -a) are the weighting coefficients for the first and 

second filters, respectively (0 <a<\\ and r and s are the filter output values from the 
first and second filters, respectively. 

25 . (Original) The system of claim 2 1 , wherein: 

the first filter comprises a polyphase filter; and 
the second filter comprises a polyphase filter. 

26. (Original) The system of claim 25, wherein: 

the first filter comprises a one dimensional FIR polyphase filter; and 
the second filter comprises a one dimensional FIR polyphase filter. 

27. (Original) The system of claim 25, wherein the two polyphase filters have the 
same length. 

28. (Original) The system of claim 25, wherein each of the polyphase filters 
comprises a -tap M -phase polyphase filter. 

29. (Original) The system of claim 28, wherein for arbitrary or variable 
interpolation ratios, M has a value of 1 0 or larger. 
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30, (Original) The system of claim 28, wherein N can be either an odd or an 
even number value. 

31, (Original) The system of claim 25, wherein each of the two filters comprises 
a low-pass filter, such that the first filter has a sharp frequency transition band and the 
second filter has a smooth frequency transition band. 

32, (Original) The system of claim 28, wherein: 

the controller calculates the weighting coefficient for each of the two 
filters by estimating the image high frequency level at the selected image position, and 
calculating a weighting coefficient for the output of the filter based on the estimated 
image high frequency level, such that Ihe image high frequency level at the selected 
image position is estimated based on the image high firequency components measured at 
original image pixels neighboring the selected image position. 

33, (Original) The system of claim 32, wherein the image high frequency 
component at the original image pixels is measured using a high-pass filtering process. 

34, (Original) The system of claim 33, wherein the image high frequency 
component at the original image pixels is measured using a high-pass FIR filter. 
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35. (Previously presented) An interpolation system that interpolates image . 
positions in an original image to produce an interpolated output image, wherein the 
original image is represented by digital input pixel data, comprising: 

a first filter having a sharp interpolation characteristic, the first filter interpolating 
a selected image position in the image to generate a sharp interpolation output value; 

a second filter having a smooth interpolation characteristic, the second filter 
interpolating the selected image position in the image to generate a smooth interpolation 
output value; 

wherein each of the first and second filters comprises a polyphase filter, and each 
of the polyphase filters comprises a A/^-tap Af phase polyphase filter; 

a controller that calculates a weighting coefficient for the output of each filter by 
estimating the image high frequency level at the selected image position, and calculating 
a weighting coefficient for the output of the filter based on the estimated image high 
frequency level such that the image high frequency level at the selected image position is 
estimated based on image high frequency components measured using a high-pass 
filtering process at original image pixels neighboring the selected image position; and 

a combiner that selectively combines the output values from the filters as a 
function of the weighting coefficients, to generate an interpolation output value for the 
selected image position of an interpolated output image; 

wherein the image hi^ frequency component at each of the original image 
pixels is measured according to the relation: 
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wherein is original image pixel value where image high frequency 
component is to be measured, and p^_^ and p^^^ are values of its neighboring pixels. 

36. (Original) The system of claim 35, wherein the image high frequency level cp 
at the selected image position is estimated according to the relation: 

N_ 
2 

N N 

wherein / = -hl,---,0,---, — are the image high frequency 

!2 2 

components calculated at the original image pixels that are within the filtering range of 
interpolation to the selected image position, f/ and g/ are filter coefficients of sub- 
filters /-^ and for the first filter and the second filter, respectively, and j is the 
interpolation phase for the selected image position. 

37. (Original) The system of claim 32, wherein the image high frequency level at 
the selected image position is estimated based on the image high frequency components 
calculated at two original image pixels closest to Ihe selected image position. 

38. (Previously presented) An interpolation system that interpolates image 
positions in an original image to produce an interpolated output image, wherein the 
original image is represented by digital input pixel data, comprising: 



16 of 24 



Patent Application No, 1 0/697,358 Docket No. SAM2.PAU.32 

Amdt. Dated December 7, 2007 

Response to Office Action of October 17, 2007 

a first filter having a sharp interpolation characteristic, the first filter interpolating 
a selected image position in the image to generate a sharp interpolation output value; 

a second filter having a smooth interpolation characteristic, the second filter 
interpolating the selected image position in the image to generate a smooth interpolation 
output value; 

wherein each of the first and second filters comprises a polyphase filter, and each 
of the polyphase filters comprises a iV-tap M phase polyphase filter; 

a controller that calculates a weighting coefficient for the output of each filter by 
estimating the image high firequency level at the selected image position, and calculating 
a weighting coefficient for the output of the filter based on the estimated image high 
fi^equency level such that the image high fi'equency level at the selected image position is 
estimated based on image high frequency components measured at original image pixels 
closest to the selected image position; 

a combiner that selectively combines the output values from the filters as a 
function of the weighting coefficients, to generate an interpolation output value for the 
selected image position of an interpolated output image; 

wherein the image high frequency level (p at the selected image position is 
estimated according to the relation: 

wherein and are the image high frequency components calculated at 
the two closest original image pixels, and are the distances between the selected 



17 of 24 



Patent Application No. 10/697,358 Docket No. SAM2.PAU.32 

Amdt. Dated December 7, 2007 

Response to Office Action of October 17, 2007 

interpolation position and the two closest original image pixels, the distance between two 
neighboring original image pixels is assumed to be 1, such that rfg + = 1 • 

39. (Original) The system of claim 32, wherein the image high frequency level at 
the selected image position is estimated based on the image high frequency component 
measured at original image pixels that are within the filtering range of interpolation to the 
selected image position. 

40. (Previously presented) An interpolation system that interpolates image 
positions in an original image to produce an interpolated output image, wherein the 
original image is represented by digital input pixel data, comprising: 

a first filter having a sharp interpolation characteristic, the first filter interpolating 
a selected image position in the image to generate a sharp interpolation output value; 

a second filter having a smooth interpolation characteristic, the second filter 
interpolating the selected image position in the image to generate a smooth interpolation 
output value; 

wherein each of the first and second filters comprises a polyphase filter, and_each 
of the polyphase filters comprises a N-tap M phase polyphase filter; 

a controller that calculates a weighting coefficient for the output of each filter by 
estimating the image high frequency level at the selected image position, and calculating 
a weighting coefficient for the output of the filter based on the estimated image high 
fi'equency level such that the image high frequency level at the selected image position is 
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estimated based on image high frequency components measured at original image pixels 
neighboring the selected image position; 

a combiner that selectively combines the output values from the filters as a 
function of the weighting coefficients, to generate an interpolation output value for the 
selected image position of an interpolated output image; 

wherein the image high frequency level cp at the selected image position is 
estimated according to the relation: 

N N 
wherein i = — ^ + 1,- • ^0,- ♦ are the image high frequency 

components calculated at the original image pixels that are within the filtering range of 
interpolation to the selected image position, f/ and gj are the filter coefficients of sub- 
filters f-^ and g-' for the first filter and the second filter, respectively, and J is the 
interpolation phase for the selected image position. 
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